The OFAI Multi-Modal Task Description Corpus
نویسندگان
چکیده
The OFAI Multimodal Task Description Corpus (OFAI-MMTD Corpus) is a collection of dyadic teacher-learner (human-human and human-robot) interactions. The corpus is multimodal and tracks the communication signals exchanged between interlocutors in task-oriented scenarios including speech, gaze and gestures. The focus of interest lies on the communicative signals conveyed by the teacher and which objects are salient at which time. Data are collected from four different task description setups which involve spatial utterances, navigation instructions and more complex descriptions of joint tasks.
منابع مشابه
Issues in Corpus Development for Multi-party Multi-modal Task-oriented Dialogue
This paper describes the development of a multi-modal corpus based on multi-party multi-task driven common goal oriented spoken language interaction. The data consists of approximately 10 hours of audio human simulation radio data and nearly 5 hours of video and audio face-to-face sessions between human trainees and virtual agents.
متن کاملMulti-modal query expansion for video object instances retrieval
In this paper we tackle the issue of object instances retrieval in video repositories using minimum information from the user (e.g., textual description/tags). Starting for a set of tags, images containing the object of interest are crawled from popular image search engines and repositories (e.g., Bing, Fickr, Google) and the positive and most representative instances of the object are automati...
متن کاملHow textbooks (and learners) get it wrong: A corpus study of modal auxiliary verbs
Many elements contribute to the relative difficulty in acquiring specific aspects of English as a foreign language (Goldschneider & DeKeyser, 2001). Modal auxiliary verbs (e.g. could, might), are examples of a structure that is difficult for many learners. Not only are they particularly complex semantically, but especially in the Malaysian context ...
متن کاملCreation of Multimodal Corpus for Modeling Turn Management in Multi-party Conversations
Spoken interactions are known for accurate timing and alignment between interlocutors: turn-taking and topic flow are managed in a manner that provides conversational fluency and smooth progress of the task. When considering applications like robot companions which interact with the user in real time, turn-taking and topic flow are also important. This paper describes creation of multi-modal co...
متن کاملTeaching Modal Verbs: Task-based vs. traditional approaches
Abstract Task-based language teaching is considered an effective way to achieve a harmony between grammar and communication. The present study investigates two different ways of teaching modal verbs: task-based versus traditional approaches. To this purpose, an Oxford Placement Test was administered to select 40 homogeneous participants out of a larger population who took this test. The selecte...
متن کامل